The thermodynamic dual structure of linear-dissipative driven systems 
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The spontaneous emergence of dynamical order, such as persistent currents, is sometimes argued 
to require principles beyond the entropy maximization of the second law of thermodynamics. I 
show that, for linear dissipation in the Onsager regime, current formation can be driven by exactly 
the Jaynesian principle of entropy maximization, suitably formulated for extended systems and 
nonequilibrium boundary conditions. The Legendre dual structure of equilibrium thermodynamics 
is also preserved, though it requires the admission of current-valued state variables, and their correct 
incorporation in the entropy. 



The search for a theory of the emergent order found 
in many driven systems, whether "self-organization" or 
"dissipative structures" 0, , presumes that these sys- 
tems are not adequately described by statistical princi- 
ples such as the second law of thermodynamics. In a 
narrow sense this is certainly true, as all driven dissi- 
pative systems conduct energy and possibly matter be- 
tween dissimilar reservoirs. However, the second law of 
thermodynamics is essentially an informational princi- 
ple i, that stable macrostates correspond to maximally 
disordered distributions of microstates, constrained by 
average values of dynamically conserved quantities like 
energy, with Shannon-Boltzmann entropy the measure 
of disorder. Nothing precludes the application of this 
principle to time-dependent systems. 

A phenomenological rule advanced to explain the form 
of currents in near-equilibrium systems is maximal en- 
tropy production [2, 14 , where "entropy" means the usual 
coarse-grained equilibrium functional of time-reversal- 
invariant state variables. Entropy production is often 
perceived as independent from the second law, capable 
of opposing it and favoring the emergence of "order" in 
some settings. However, the entropy production function 
presumes equilibrium state variables remain meaningful, 
implying that the fine-grained configuration of the sys- 
tem locally obeys the second law in the usual sense. 

Here I consider a model of linear dissipation in the On- 
sager regime 4], obtained from first principles by typical 
methods of quantum optics |5j , but given sufficient struc- 
ture to represent an extended system capable of coupling 
to multiple reservoirs with dissimilar temperatures. In 
equilibrium systems, the value of any intensive state vari- 
able is necessarily the same for all system degrees of free- 
dom, and dual to each intensive variable is an extensive 
distribution-averaged observable obtained by Legendre 
transformation. The imposition by the boundary con- 
ditions of multiple values for a single intensive variable 
overconstrains the system relative to an equilibrium, and 
leads to spontaneous emergence of persistent currents. 
However, I show that the stable states of such driven 
systems remain consistent with Jaynesian maximization 
of the exact entropy, subject to constraint of distribution- 
averaged observables. Further the Legendre dual struc- 
ture of equilibrium thermodynamics is preserved, if one 
admits current-valued (time-reversal asymmetric) as well 



as charge-valued (symmetric) state variables, and com- 
putes the entropy as a function of both. 

The result is that macroscopic as well as microscopic 
features of the distribution are determined uniformly by 
entropy maximization. The dynamical distribution is 
more ordered than an equilibrium distribution at the 
same average energy simply because its boundary con- 
straints are more structured, which is also the origin of 
the second law in equilibrium 0. Maximum produc- 
tion of coarse-grained entropy may be recovered as a 
phenomenological rule from fine-grained entropy maxi- 
mization at each time, once the latter has ensured that 
all local marginal distributions are thermal and that the 
equilibrium state variables have their usual meaning. 

The model is similar to Fock space models used in 
quantum optics, where linear dissipation is readily de- 
rived as a universality class [f| . The physical state space 
of the system results from the action of D orthogo- 
nal creation and annihilation operators starting from a 
ground (ket) state |0). They have commutation relations 
[a M , al] = 5%, fi, v G 1, . . . , D. The system has a "spa- 
tial" basis indexed i, in which reservoir coupling is diag- 
onal, and a (generally different) basis indexed p in which 
the Hamiltonian is diagonal. 

In any basis, the diagonal elements of the dyadic ma- 
trix operator h = a^a (i.e., [n£J] = [a^a^] ) constitute a 
set of the independent number components in the Fock 
space. The Hamiltonian (up to constants) is written 
H = Tr [En], with eigenvalues E£ = S^E^y 

For a column vector £ = of complex scalars, a 
general coherent state for the system is compactly written 
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A subset of density matrices in the Glauber- Sudarshan 
P-representation [5|, which represent thermal and near- 
thermal conditions, are those diagonal in |£) with Gaus- 
sian density 



p = Det(K) J ^ 



10 (£1, 



(2) 



where K is a D x D Hermitian kernel. Gaussian- 
coherent densities have the property that all marginal 



2 



distributions for a single degree of freedom P a {n a ) = 
Tr (p \n a ) (n a \) are exponential in n a in any basis 0. 
They include the equilibrium thermal distributions 
(K£ = 5^ (e@ E ^ — 1J), and also general time-dependent 
distributions created by linear dissipation, from arbi- 
trary Gaussian-coherent initial conditions. Though all 
marginals are effectively thermal, in nonequilibrium cases 
different marginals generally have different effective tem- 
peratures. 

The kernel K is the inverse expected number operator 



Tr (pn) = K 



(3) 



and the exact quantum entropy has the von Neumann 
form Q 

S(p) = -Tr(plogp) 

= Tr [(I + n) log (/ + n) - n log n] , (4) 

(in which parentheses denote density matrix trace, and 
square brackets the scalar matrix trace over index p). 
Gaussian-coherent ensembles are specified among gen- 
eral density matrices p by standard Jaynesian entropy 
maximization, 



6 p , x {S(p)-Tr[\(Tr(pn) 



K~ 1 )]}=0, (5) 



where A is a matrix of Lagrange multipliers enforcing a 
constraint on the trace of the number operator h. The 
partition function of the distribution J2J) is indistinguish- 
able from that for a tensor product of thermal states 
(diagonalize K), and evaluates to 



log Z = Tr [log (I + n)} = S(n) - Tr 



6S(n) 



(6) 



The master equation for a general system density p, 
minimally coupled to as many as D reservoirs (one per 
system degree of freedom), is @ 



dp 

dt 
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Tr [n] = a^a^, is the total number operator, and 

= nti 



S/j = Tr (nun) — a],{n R ) is a source of particles 
from the reservoirs. The detailed structure of the reser- 
voirs does not matter, though n R has the interpretation 
of a mean excitation number in reservoirs that are also 
systems of linear oscillators. The entropy (@J is coarse- 
grained |(J because it results from projection of a re- 
versible (system <g> reservoir) ensemble onto the degrees of 
freedom of the system alone. Constant n R characterizes 
sufficiently high temperatures and reservoir dimensional- 
ity |5(. Finally, Eq. Q) is an effective field equation, in 



which Green's function corrections from system-reservoir 
coupling have been absorbed in specifying H and T,r. 

Eq. J7J) preserves Gaussian-coherent ensembles, with 
only mean particle number evolving as 



dn 



+ r (ur - n) 



(8) 



Particles diffuse from the system in proportion to n, and 
conversely from the reservoir in proportion to tir. In 
a high-temperature (Boltzmann) regime, particle statis- 
tics play no special role, and linear particle exchange is 
expected to be representative of ubiquitous diffusion re- 
lations such as the Fourier and Ohm laws. 

If [E, n r] = the eigenvectors of H are coupled in- 
dependently to different reservoir components, and in 
steady state p decomposes into a tensor product of in- 
dependent thermal subsystems. [E, ur] ^ describes 
"open" systems, in which unequal intensive state vari- 
ables from different components of tir induce persistent 
currents at steady state. 

The entropy (0} evolves under Eq. (JSJ) as 



-rTr 



(n - n R ) - 
= r[A(p;p R )-S(p)- 



= rTr[(p- p R )logp] 
S(pr)}, (9) 



where A(p; pr) is the Kullback-Leibler pseudodistance 
A (p; p R ) = Tr [p R (log pr - log p)\ 



Tr 



(I + n R )log(I + n) (I + n R )' 



nRlognn^ 1 , 
(10) 



and pr is to be understood as the Gaussian-coherent en- 
semble the reservoirs "attempt to impose" through n R . 

The steady state condition dS/dt = is equivalent to 
the condition S(p) — S(pr) = A(p; pr) that p be a coarse- 
graining of pi? [jj. Geometrically, n R = n — i [E, n] jr is 
in the tangent plane to the surface SS — at n, because 
although S(p) arises from a projection, unitary evolution 
% [E, n] within the system preserves the value of S(n). 

We will generally retain time-dependent n for compar- 
ison to the Onsager construction, but it is convenient to 
have a closed form for the asymptotic late-time distribu- 
tion, denoted 



// = / rdte- rt e lEt n R e' lEt . 
In components in the Eigenbasis of the Hamiltonian, 



(11) 
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The physical reason for the emergence of currents 
from coarse-graining is nicely illustrated in the asymp- 
totic solution to the simplest nontrivial example, a two- 
dimensional oscillator with Hamiltonian 



E = 



Ey 



En 



(13) 
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and E x ^ E y . General Hermitian n take the form 



n Q +n 3 m + in 2 
rii - in2 no - n 3 



(14) 



with coefficients related to the physical state basis of 
Fig. n by 2n 3 — n x — n y , 2ni = n u — n v , 2n 2 — n + — n_ . 
If by convention nr x ,y) and nr u> v) refer to standing waves, 
n± are traveling waves exchanged under time rever- 
sal. Then the coefficients of real n are charge-valued 
state variables, and the single imaginary coefficient is a 
current-valued state variable. As the entropy Q is pre- 
served by arbitrary similarity transformation of n under 
SU(2), charge and current state variables have identical 
interpretations in terms of statistical uncertainty. 
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FIG. 1: Three bases for the two-dimensional oscillator, xy 
(solid) is the eigenbasis of the Hamiltonian. uv (dash) is the 
"spatial" basis in which a thermal asymmetry is imposed by 
riR. ± (dotted) is the current basis excited spontaneously, 
and switched under time reversal. 



Hamiltonian evolution preserves no and n 3 , and oscil- 
lates net charge and current excesses in time as 



(rii + in 2 ) 



-Ey)t 



(m + in 2 ) Q . 



(15) 



The set of coarse-grainings of real tir preserving no and 
ri3 is given by (m + in 2 ) x = (nn) 1 / (1 — iX) for real A, 
and shown in Fig. By Eq. (|12(l for n, we solve for A = 
(E x — Ey) jr. The current magnitude \h 2 \ is maximized 
at r 2 = {E x -E y f. 

We may generate spontaneous currents in an extended 
system as follows: At equilibrium no ± n 3 ^ 0, while 
rii = (reflection symmetry), and n 2 = (time- reversal 
invariance). If we couple the orthogonal (u,v) operators 
to static reservoirs with different temperatures, consis- 
tent with the same n ± n 3 , linear dissipation attracts 
ri in Eq. |J5j toward a charge asymmetry (nn) 1 =/= 0, 
which refines the equilibrium ensemble with a new con- 
straint, thus reducing its entropy. Dissipation just bal- 
ances Hamiltonian charge/current conversion at a coarse- 
graining n of ur, where < \n\ + ifi 2 \ < Kn^J, allow- 
ing a larger entropy than S(nn) but less than equilibrium 
for the same average system energy. 

Returning to the general case, we may derive the clas- 
sical thermodynamic dual structure for arbitrary target 
n T . If through Eq. 1|11[) we define 



A r 



SS(n T ) 



log (1 + n- 1 ) 



(16) 
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FIG. 2: Coarse-graining from a charge ni to a current ni. 
Concentric circles are Hamiltonian orbits, and dashed circle 
is the set of coarse grainings from given (ur) 1 . The angle a 
obeys tana = 1/A = rj (E x — E y ). 



the remaining degrees of freedom in arbitrary Tr (ph) are 
fixed by maximizing S(p) subject to the single constraint 
Tr [(Tr {ph) ~ n T ) A T ] = 0, because the set SS > from 
any n T is convex. Entropy maximization with one La- 
grange multiplier for an extensive trace constraint, 



5 P , A {S(p) - X T [Tr (Tr [hA r ] p) - Tr [n T A T ]]} = 0, 



(17) 



is thus a sufficient principle to extract p(n T ), but fails 
to capture the physical role of the temperatures in the 
reservoir as independently specified intensive state vari- 
ables. 

The state variable interpretation of reservoir parame- 
ters is recovered naturally, and indeed linearly, in the On- 
sager regime of high temperature and weak perturbation 
away from equilibrium. Suppose, for example, that the 
trace constraint on comes from average energy and 
some other charge matrix Q. Suppose a high temperature 
/3.E( M ) <C 1, and weak perturbation P'Q^/flE^) <C 1, 
for all eigenvalues Ei^\ of E and Qr v \ of Q. Q is a charge 
if it is Hermitian with real coefficients. With these trace 
constraints, we may expand nu to leading order 
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Under Eq. (JSJ) we may then write 



E~ 



E' 



as long as 







-(3'J E 







JE+/3'J _ 1 



dJ 
~dt 



i [E, J}+r(Q- J) 



(18) 



(19) 



(20) 



If we think of Q as denominated in energy units, 
1/ (/3 =F /3') = kT± are the two temperature parameters 
represented in the environment. Dual to the average tem- 
perature 1/0 is an average energy 



Tr [nE] = Tr [n R E] = S, 



(21) 
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(equal to that in tir), and dual to f3' / (3 2 is a new trace and jr = tir, we may then write Eq. (|26() as 



Tr [nJ] = J. 



(22) 



Denoting the Hcrmitian operators formed from Q and J 
Q = Tr [Qh] and J = Tr [Jn] respectively, the steady 
state distribution solves the maximization problem 



Tr (tip) -£ - A' Tr (jpj -J } = 0. 

(23) 

Dual to entropy maximization l|23|l under extensive state 
variable constraints is the minimization with intensive 
constraints, 

S p {/3Tr (Hp) + p'Tr (jp) - S{p)) = 0. (24) 

Reducing to the residual dependence on n, we recognize 
that this is the minimization of the log inverse partition 
function JHJ 

5 n {-logZ} = 6 n {Tr[(pE + f3'j) n] - S{n)} = 0, 

equivalent to minimization of the Helmholtz free energy 
for the equilibrium canonical ensemble. 

The phenomenological result of maximal entropy pro- 
duction, a variational principle for the diffusive currents 
of equilibrium state variables, follows from minimization 
of the generalized exact free energies (|25|) in the Onsager 
regime. The phenomenological entropy is obtained by 
coarse-graining the exact distribution to a product of its 
marginals on different spatial positions. The equivalent 
operation here is the projection of p onto its diagonal 
components p in a Fock space over independent num- 
ber excitations. The resulting coarse-grained entropy is 
a function of the charge- valued state variables only. 

As we have only introduced notation and derived linear 
particle exchange for factoring the (system <S> reservoir) 
distribution into independent marginals, that partition 
will be used as an example. It simplifies the presen- 
tation to consider the reservoir a unified system in its 
own right (rather than a set of independent components), 
with state variable nR, and distribution pR extremized 
as in Eq. except with trace constraint j3E+/3'Q, for 
consistency with Eq. . Label the reservoir partition 
function Zr, and its entropy Sr computed from pr as 
for S(p). Let overdot denote time differentiation. Then 
consider the potential 



dt 



\o S (ZZr) = S-Ty 



(j3E + 13'. J) h - (3' 'Jn 



Sr - Tr 



(pE + 13' Q) riR ~ P'QriR (26) 



Use Eq. (|2U|I to evaluate J, and by symmetric treatment 
of system and reservoir let Q = r (J — Q) (taking the 
reservoir energy diagonal in ur purely for convenience). 
In terms of currents defined phenomenologically from n 
and n R , 



dt 



log {ZZr) = Tr 



5S_ 

Sn 



PE - J j 



+ (j^- -PE- P'Q^j JR -13' (J- Q) (n - n R ) 

(28) 

Maximization of log Z and log Zr at each time is equiva- 
lent to saddle-point extremization of Eq. I|28|l , maximiz- 
ing in j and jr, minimizing in n and ur. 

For high temperatures and linear perturbations it is 
convenient to write n — [f3E) +Sn, ur — {(3E^ +5tir, 
and Eq. I|28|l is readily expressed to leading order as a 
difference of quadratic forms in these variables. Variation 
with Sn + Sur then sets j + ]r, — 0, and variation with 
j + jr recovers the sum of forms ()18ll9ll . Variation with 
Sn — SnR gives Sn — SnR in terms of j — jr, recovering 
the linear dissipation rule. Evaluating Eq. I|28() on these 
three extrema leaves the function of (j — jr) /2 — > j: 



dt 



\og(ZZ R ) = 4rTr 



P (Q-J)3-^(PE)j(0E)j 



r(2r- 1) Tr [(f3E) [3'(Q - J) ((3E) 0'{Q - J)] 



(29) 

The linear form Tr [ft' (Q — J) j] is Onsager's "entropy 
production rate" , with the difference of inverse temper- 
atures j3' {Q — J) regarded as constants under variation, 
while 



<P(j,j) = ^-Tr [(pE)j(pE)j] 



(30) 



j = h — i [E, n] 



(27) 



is the phenomenological "dissipation function" . Under 
complete coarse-graining of both system and reservoirs, 
the single function (|2~9"|> would expand into the structure 
of physical diffusion currents determined by the Hamil- 
tonian, though the resulting coarse-grained entropy, even 
within the system, would progressively diverge from the 
exact value Q. 

This formal demonstration that spontaneous emer- 
gence of persistent currents need not require any new 
principles beyond Jaynesian entropy maximization po- 
tentially changes our understanding of the statistical na- 
ture of dynamical order. States with currents are poten- 
tially equivalent to equilibrium ground states, with the 
dual representation of noncquilibrium boundary condi- 
tions taken up by dynamical or time-reversal-asymmetric 
extensive observables. 

It was previously shown [jj that entropy maximization 
naturally extends from equilibria to cases of thermody- 
namic reversibility, an intuitive result because state vari- 
ables at different times index the same constraint set. 
Less obvious, when such systems support self-organizing 
phase transitions 0, their finite-temperature field the- 
ory pH | retains the structure of equilibrium up to analytic 
continuation, suggesting that nonlinear positive feedback 
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is also consistent with entropy-maximization, if one takes 
care with broken crgodicity. The current demonstration 
for linear-dissipative systems extends this result to cases 
in which coarse-grained entropy is not preserved. It re- 
mains to determine whether positive feedbacks that in- 
duce phase transitions in dissipative systems have a sim- 



ilar formulation. 
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